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Abstract. By using the probability approach (the Malliavin calculus), we prove the existence 
of smooth fundamental solutions for degenerate kinetic Fokker-Planck equation with anisotropic 
nonlocal dissipativity, where the dissipative term is the generator of an anisotropic Levy process 
and the drift term is allowed to be cubic growth. 



1. Introduction AND Main Result 



id. 



Consider the following second order stochastic differential equation (SDE) in 

§^ = ™-^-^'^» = - 

Oh . dt 

^ ! where V{x) : R'' — > R.+ is a smooth function, and (V7,)f^o is a J-dimensional standard Brow- 
c3 I nian motion. In phase space Rf x R^, the position and velocity vector field (X,,Xt) solves the 
following degenerate SDE: 

( dXr = Xtdt, Xo = X, 

^ \ . . . (1-2) 

^ ■ \dXr = -VV{Xt)dt - Xrdt + dWt, Xq = v. 

■ The celebrated Hormander's hypoellipticity theorem tells us that admits a smooth den- 

sity p.v,v(?, x', v') (cf. |[ni[l6l[l9l[l8l|201). Moreover, by Ito's formula, one knows that p,^^{t, x', v') 
solves the following kinetic Fokker-Planck equation: 
O ■ 

m ■ dtp-V ■ Vv'P + VV ■ Vv'P = Av^p - div(v'p). 

It is easy to check that the equilibrium of this equation is given by 



^ ; PooU,v) := exp[-H{x,v)}, where H{x,v) := ^ -I- Vix). 

. The rate of convergence to the equilibrium for the kinetic Fokker-Planck equation has been 
deeply studied in [[8l[l0ll27l|9l, etc. Moreover, the stochastic flow property of SDE (11.21 ) was 
proven in [[D |30l . 

In this work, we shall consider equation (|1.11 ) with Brownian motion {Wt)tM) replaced by a 
Levy process (L,),^o (for example, the cylindrical a-stable process). More generally, we con- 
sider the following stochastic Hamiltonian system driven by Levy process: 

(dX, = bi{Xt,X,)dt, Xo = x, 

I . . . (1.3) 

[dX, = b2(Xt,Xt)dt + dLt, Xo = v, 

where b = {b\,b2) is a smooth vector field on phase space Rf x R^. The background about 

stochastic Hamiltonian system and related Fokker-Planck equation is refereed to [25 1. From the 

microscopic viewpoint, stochastic equation (11.31 ) can be considered that the motion of particles 

is perturbed by a "discontinuous" stochastic force. We want to study the regularizing eff"ect of 

Levy noise to the system. It is well known that there are a lot of works devoting to the study 

of smooth densities for SDEs with jumps (see [|6l[51ini|26l[I2ll2l[Hllll, etc.). Nevertheless, 
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most of these works required that the jump noise is non-degenerate, and the main arguments 
are based upon developing an analogue of the Malliavin calculus for jump diffusions. 

The main goal of the present paper is to prove that under some assumptions on b and L,, 
the solution (Xt,X,) of SDE (|1.3I) still has a smooth density. When b has bounded derivatives 
of all orders, {VybiXV^bi)* is uniform positive with respect to (x, v), and L, is an isotropic 
or-stable process, the smoothness of p was proved in [|32l . However, in real model such as 
stochastic oscillators, the nonlinear term b is usually non-Lipschitz, and the Levy noise may be 
anisotropic as that each component of L, is independent. 

Below, we first describe the noise L, following [14J. Let (L,),^o be a J-dimensional Levy 
process with the following form (called subordinated Brownian motion): 



where St = {Sj,--- ,5f) is an independent J-dimensional R^J-valued Levy process with char- 
acteristic triple {■&, 0,vs) , more precisely, its Laplace transform is given by 



= exp • z + J/e"-^ " - 1)^5 (dM)| , (1.4) 



where -& eW^ and the Levy measure satisfies 

(1 A |M|)V5(dM) < OO. 



r 



In particular, each component 5 J is a subordinator (cf. DH |241). By easy calculations, one can 
see that the characteristic function of L, is given by 



Je''-'^' = exp 



|-? Yj '^^I^^I' + ^ Jj^'''' - 1 - • jl|.vKi)vL(d3;)| , (1.5) 



where is the Levy measure given by 

VL(r)= r (r ^^""^ . e"^^"-"^>i • --dyAvsiduu ■ • • ,dud). (1-6) 

jRf \Jr (Mi • • •Mrf)2 / 

Here we use the convention that if w, = for some z, then the inner integral is calculated 
with respect to the degenerate Gaussian distribution. In particular, vi may not be absolutely 
continuous with respect to the Lebesgue measure. Obviously, vl is a symmetric measure. 
Now we state the main assumptions on (i?, v^) and b: 

(Hi^) Let : ]R+ ^ ]R+ be defined by 

0(e) := min;=i,...,rf(??; + - f UiVsiduM . (1.7) 



We assume that for some 6 (0, 1], 



lim£^-V(£) > 0. (1.8) 



(Hj^) We assume that for any p > 0, 

e'*'iv5(dM) < OO, (1.9) 



VS' 

J\u\>\ 

which, by f24. p. 159, Theorem 25.3], is equivalent to 

Ee''^'<co. (1.10) 
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(H^,) Assume that there exists a Lyapunov function // : R.f x R^' — > R+ with 

W.Hf^CiH, Wlm^Cj, (1.11) 
and such that for any m e {0} U N and some > 0, 

b VH < C3H, \V"b\ < C„{W"' + 1), (1.12) 
where qi e [0, Moreover, 

|V,&| + |V>| + |V>| < C4, (1.13) 
and for any row vector u eW^, 

\uVMix,y)\^ >C5\u\^. (1.14) 

Remark 1.1. Let (5'J),=i ... be independent a r stable subordinators, where a,- e (0, 1). It is easy 
to check that A1.8\) holds with 6 = min(Q'i, • • • , a^). 

Remark 1.2. In the case of equation ALU , we can take 

H{x,y)=^-\v\^ + V{x\ 

where V e C°°(W^; R.+) satisfies that for any m e N and some q,„ > 0, 

\V'"Vix)\ < CUVixr- + 1), 

with q2 = \. In particular, V{x) = \x\^ satisfies this assumption. Since for any p > I, compared 
with ilLlOk it holds in general that (cf. [|24l p.l68, Theorem 26.1]j 

Ee'^'' = 00, 

we have to require qi e [0, ^] in U.12\l (see Theorem \3. 1 1 below ). 

The main result of this paper is: 

Theorem 1.3. Under (H^^ ), (Hj^ ) and (H^), there exists a smooth density Px^y{t,x' to SDE 
(123]) with bounded derivatives of all orders with respect to x', v' and such that 

d,p = Xv'P + diWy' (bp), r >0, 

with pv,v(0, x', v') = 6^-y{x',v'), where 

£Jiw) = P.y. [ (fiv + y)-fiw))vddy) + \yidlf)m,, 

where P.V. stands for the Cauchy principal value. Moreover, there exist constants fii,j32,fi3 > 
only depending on d, 6 and a positive continuous function {x, v) 1— > Cx^^ such that for all 
(t, (x', v'), (x, v)) e (0, 1] X (Ri X Rif, 

P„(,,.'.v') < c„(r^. (1 A (1.15) 

Remark 1.4. If b e C^(R''), then the above Cx,y can be constant. In this case, if one only 
requires the existence of smooth density, then assumption (H^^, ) can be dropped by using the 
same argument as in [32, Section 3.3]. 
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In order to prove this theorem, by taking regular conditional expectations with respect to S ., 
we shall regard the solution of SDE (11.31 ) as a Wiener functional, and then use the classical 
Malliavin calculus to prove Theorem 11.31 Such an idea was first used by Lendre [TT], and 
then in [I4l [3T]|. We also mention that a derivative formula of Bismut type and the Hamack 
inequality for SDEs driven by a-stable processes were derived in [31 J and [28J following the 
same idea. It is quite interesting to have an analytic proof of Theorem 1 1.3 1 It should be noticed 
that the Levy measure vl could be very singular. This leads to that the symbol of operator Xv 

0(^):= r (l-e'<^'>>-l|,|,i<^,3;))v,(d3;) + ^yi?,^,2 

may not be -continuous differentiable on R'' \ {0}. Thus, the classical pseudo-differential 
operator theory seems not applicable (cf. IHTI ). Below, we list some open questions for further 
studies: 

• Can we prove the same result for multiplicative Levy noise? 

• Is it possible to remove the assumptions qi e [0, |] in (|1.12l) and (Hj^.)? 

• Is there a stationary distribution for stochastic Hamiltonian system (11.31) ? If yes, how 
about the rate of convergence as ? — > oo? 

This work is organized as follows: In Section 2, we prepare some notations and lemmas for 
later use. In particular, a Norris' type lemma is proven. In Section 3, we prove some exponential 
moment estimate about the SDE driven by Ws, and with polynomial growth coefficients. In 
Section 4, we calculate the Malliavin covariance matrix for the solution of SDE as a Wiener 
functional. In Section 5, we prove the smoothness of distributional density of a degenerate SDE 
driven by Ws,. Meanwhile, we conclude the proof of Theorem 11.31 Before concluding this 
introduction, we collect some notations or conventions for later use. 

• Write = [0, oo)^ and No = {0} U N. 

• The inner product in Euclidean space is denoted by (x, y) or x ■ y. 

• For a vector x = (xi, • • • , xj), we write \x\ := ( 2i U/l ) ~ Z/ U/l- 

• C^CR''): The space of all smooth functions with compact support. 

• S(^y. The Schwardz space of rapidly decreasing smooth functions. 

• C^i^y. The space of all smooth bounded functions with bounded derivatives of all 
orders. 

• Cp (R''): The space of all smooth functions, which together with the derivatives of all 
orders are at most polynomial growth. 

• The asterisk * denotes the transpose of a matrix or a column vector, or the dual operator. 

• V denotes the gradient operator, and D the Malliavin derivative operator. 

• C with or without index will denotes an unimportant positive constant. 

2. Preliminaries 

We first introduce the canonical space of subordinated Brownian motion Ws,- Let (W, H,/iw) 
be the classical Wiener space, i.e., W is the space of all continuous functions from R+ to R'^' 
with vanishing values at starting point 0, H c W is the Cameron-Martin space consisting of all 
absolutely continuous functions with square integrable derivatives, //w is the Wiener measure 
so that the coordinate process 

:= Wt 

is a (i-dimensional standard Brownian motion. Let S be the space of all cadlag functions from 
R+ to R^ with = 0, where each component is increasing. Suppose that S is endowed with the 
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Skorohod metric and the probability measure jUs so that the coordinate process 

Sr{£) :=£, = {€],■■■ 

is a J-dimensional Levy process with Laplace transform (I1.4I ). Consider the following product 
probability space 

and define for (w, ^) e W x S, 

L,(,wJ) := We, := • • • ,wMt))). 

Then (L,),^o is a Levy process with characteristic function (|1.5t . We use the following filtration: 

:=cr{W5.,5.v: 

Clearly, for t > s, Ws, - Ws^ and 5, - 5. , are independent of 

2.1. An exponential estimate of 5,. The following estimate of exponential type about 5, will 
play an important role in the proof of Theorem 11.31 

Lemma 2.1. Let /, : R+ ^ 1.^ be a continuous .^t-adapted process. For any R,s,5 > 0, we 
have 

where Tr := inf{? > : |/,| > R} and (p is defined by (17771). 
Proof. For A> 0, set 

g]:= r (l-e-'^^' >5(dM) 
and ^ ^ ^ 

Jo Jo Jo 

Let ix{t, du) be the Poisson random measure associated with 5,, i.e., 

M?,r):=_^lr(5,-5,.), T e mK)- 

Let du) be the compensated Poisson random measure of ix{t, du), i.e., 

fl{t, du) = yu(?, dM) - tvs{du). 
Then, by Levy-Ito's decomposition (cf. ^2M ). we can write 

St = t\§+ 1 MVsCdw) + 1 up.(t,du)+ I upi{t,du), (2.1) 

\ J|w|<l / J|m|<1 J|m|>1 



and so. 



r /vd5, = r f,-U+ [ uvsm]ds 

Jo Jo \ J|hK1 / 

11 /, ■ ufiids, du)+ I I f, ■ unids, du). 

JoJlukl JoJ|h|>1 



+ J 

By Ito's formula (cf. 0), we have 



Since for any x > 0, 

1 - e""^ < 1 A jc, 
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we have 

gi< f {lA{Af,-u))vsm 

and 



<A \ gids < tR\&\ + t \ (1 A (AR\u\))vs(du). 



Hence, by (|2.2I) we have 



JO 



d 



Ee^'--« = 1. 



On the other hand, since for any a: e (0, 1) and x < - log k, 

1 - e"'' > Kx, 

letting K = ^, we have for s <Tr, 

>Af,-i9+- f (Af,-u)vs(du) 

fir ) 

= Af,- &+- uvsidu) 
>Acp{l/(AR)M\, 



where is defined by (|1.7I) . Thus, 

U /,-d5,<e; |/v|d5>5 

which then implies the result by Chebyschev's inequality and letting A = K □ 

2.2. A Norris' type lemma. Let N{t, dy) be the Poisson random measure associated with L, = 
Ws„ i.e.. 

Let N{t, dy) be the compensated Poisson random measure of N{t, dy), i.e., 

N{t,dy) = N{t,dy)-tvddy), 
where vi is the Levy measure of L, given by (11.61) . By Levy-Ito's decomposition, we have 

L, = Ws, = W,,,+ r yN{t,dy)+ r jiVa,dj), (2.3) 

J|«|<1 J|u|>l 

where we have used that for any < r < R < oo, 

yviidy) = 0. 



/r<|>i<i? 

Notice that {W^^dm, ( yN{t, dj))^^^ and ( yN{t, dy))^^^ are independent. 

Recall the following result about the exponential estimate of martingales (cf. [1201 p. 352, 
(A.5)] and [7. Lemma 1]). 
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Lemma 2.2. Let 6, R,j],T > 0. 

( i) Let Mt be a continuous square integrable martingale, then 

P I sup |M,| > 5; {M)j <r\<2 exp 
Wvdj] ) \ , 

( ii) Let ftiy) be a bounded ^rpredictable process with bound R, then 
^' r 



P< sup 

l'e[0,7-] 




\ \ |/,(3;)|^y^(d3;)d5 < 77 U 2 exp - 



2{R6 + 77) 



/o Jm' 

The following lemma is contained in the proof of Norris' lemma (cf. [|20l p. 137] and OTjl ). 

Lemma 2.3. For T > 0, let f be a bounded measurable -valued function on [0, T\ Assume 
that for some e <T and x e R'', 

I f^t 2 

"As 



Jo Jo 



dt<s\ (2.4) 



Then we have 



sup I /,d*| < 2(1 + \\f\Us. 

te[0,T] I 



I Jo 

We now prove the following Norris' type lemma (cf. [[T9l l20l U\ 1311 ). 
Lemma 2.4. Let = y + ^'jS^d^' be an W' -valued process, where /3t takes the following form: 

/3t=/3o+ f 7sds+ [ QAW&,+ [[ g,,(y)Nids,dyl 
Jo Jo JoJr'I 

where : 1R+ ^ W^, Qt : R+ ^ x R"' and gt(y) : R+xR'' ^ are three left continuous 
^t-<^dapted processes. Suppose that for some left continuous ^t-<^dapted R+-valued process at, 

\gt(y)\ < a.(l A \y\). (2.5) 

Then there exists a constant C > 1 such that for any t e (0,1), 6 e (0, |), s e (0, t^) andR > 1, 

pS^tr >t,J^ \Yfds <s,J^ Ififds > 97?V| < 4exp|-^l, (2.6) 



where 



tr := mf[t >0:m + M + \Qt\ + a, > R). 

Proof Let us define 

hr.= f I3.4s, M^:= [ {h,,Q,4W,.X Mf:= [[ {h„ g,iy)mds,dyX 
Jo Jo JoJvJ 

and 

Ei :=\ [ \Ys\^ds <s\, £2 := ( sup \h,\ < 4Rs-^] , 
[Jo ) bmt] ) 

£3 := {{M')t < CoR's^} , £4 := I sup |MJ| < , 

lse[0,f] ^ J 

E5 := {{M% < CiR's-A , Ee:={ sup \M'^\ < ^| , 

lve[0,f] ^ J 
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where Co and Ci are two constants determined below. 
First of all, by Lemma 1231 one sees that for s < T^, 

{tr >t}nEic {tr > n £2 c {tr > n £3 n £5, (2.7) 

where the second inclusion is due to 

{M'\ = [ \{h„ QM^ds < {4RfR'\^\h^^ =: CoR's'^ 
Jo 

and 

{M% = f f \{h„gAy)}\Wdy)ds < (ARfR^i f 1 A \y\W(dy)]s"^ =: C,R'sI 
JoJw XJw I 

On the other hand, by integration by parts formula, we have 

r ^/d^= r {J5,,Ahs) = (fiuh) - r {h,y,)dt-M';-M^. 
Jo Jo Jo 

From this, one sees that on {tr > Pi £2 ^ E4, 

[ \/3/ds < 4i?2e5(i + ^) + < (8i?2 + i)g^ ^ gR^gS 
Jo 

This means that 

{tr > n £2 n £4 n Eg c [tr > n £7, 

which together with (|2.7I) gives 

{tr > n £1 n £^ c {tr > n £1 n u El) 
c ({t« > n £3 n u ({t« > n £5 n £2 n 

Thus, by Lemma [X^ we have 

p({tr >t}nEin E',) < p(e, n + /'({tk > n £2 n ^5 n 

< 2 exp ■ 





1 + 2 exp |- 










1 + 2 exp 1 





8(4 + Ci)i?4 

and (|Z6l) follows by choosing C := 8(Co V (4 + CO). □ 

2.3. Malliavin's calculus. In this subsection we recall some basic notions and facts about the 
Malliavin calculus (cf. [[T5l[ISl|201). Let U be a real separable Hilbert space. Let "^(U) be the 
class of all U- valued smooth cylindrical functionals on D with the form: 

in 

F = Y,fimhi),---,W(K))Ui, 

i=l 

where e C^iR"), w,- e U, • • • , /z„ e H and 



The Malliavin derivative of F is defined by 

m n 

DF := Yjidjfdmh), W(h,))Ui ®hjeV®n. 
i=i j=i 



By an iteration argument, for any ^ e N, the higher order Malliavin derivative D^F of F can 
be defined as a random variable in U (8) H®*". It is well known that the operator (D*", ^(U)) is 
closable from LP{Q.\ U) to LP{Q.;V ^W^^) for each p > 1 (cf. [[201 p.26, Proposition 1.2.1]). For 
every p> \ and e N, we introduce a norm on ^(U) by 



lli^ll 



Kp — 



E|Fr + 2^E(||D'F||j;„) 



/=1 



The Wiener-Sobolev space D*''''(U) is defined as the closure of "^(U) with respect to the above 
norm. Below we shall simply write 

D~(U) := n,„eN,p^iD'"'^(U) 

and 

D*'^ := D*'^(R''), W := D'^CR^). 
The dual operator D* of D (also called divergence operator) is defined by 



E{DF,U)ji = E{FD*U), U eDom(D*) 



a,2 



(H). 



The following Meyer's inequality holds (cf. [20, p.75, Proposition 1.5.4]). For any p > \ and 

U e Di'P(H), 

\\D*U\\p < Cp\\U\\i,p. (2.8) 

Let F = (F\ ■ ■ ■ ,F'^) be a random vector in D^'^. The Malliavin covariance matrix of F is 
defined by 

{^F)ij:={DF\DF% 

The following theorem about the criterion that a random vector admits a smooth density in 
the Malliavin calculus can be found in |[20l p. 100-103]. 

Theorem 2.5. Assume that F = {F^, • • • , F'^) G D°° is a smooth Wiener functional and satisfies 
that for all p > 2, 

E[(detSf)-''] < oo. 



,a,n) e {1,2,- ■■ ,dr, 



(2.9) 



Let G e D°° and (p e C"(R^). Then for any multi-index a = {a\, ■ 

E[5„^(F)G] = E[ip{F)H„{F,G)l 
where da = ■ • ■ da,,,, and Ha{F, G) are recursively defined by 

H^i){F,G) -Y.D^GiT.^DFi), 

j 

Ha(F, G) := H(a„)iF, H^a^- ,a„,-i){F, G)). 

As a consequence, for any p > 1, there exists pi,p2,P3 > 1 andn\,n2 e N such that 

\\Ha{F,G)\\p < CmaI.F)-X\\\DF\T^J\G\L^p^. 

In particular, the law of F possesses an infinitely dijferentiable density p e S(^^). 

About the estimate of the density, we recall the following result from Kusuoka-Stroock [[TSl 
Theorem 1.28]. 

Theorem 2.6. In the situation of Theorem 12.51 for any q > d, there exists a constant C = 
Ciq, d)>0 such that for any if/ e C'^(W'), 



(2.10) 



sup\ilf(y)p{y)\<CmF)\l 



J]\m)iF,l)\\, _^||//(o(F,^(F))||, 



V i 



V i 



(2.11) 



provided that the right hand side is finite. 

3. Exponential moment estimate for SDEs driven by Ws, 

In this section, we mainly prove some estimates about the exponential moments for the solu- 
tions of SDEs with non-Lipschitz coefficients. Consider the following SDE driven by Ws,'- 



dXt = biXt)dt + AdWs,, Xo = x, 

where : R'' — > R'^ is a smooth function and A = is a constant dx d matrix. 
Recall that a C^-function // : R'' — > R^ is called a Lyapunov function if 

lim H{x) = oo. 

We assume that for some Lyapunov function H and ki,K2, > 0, 

bix) ■ VH(x) < KiHix), 



and for all = 1 , ■ ■ ■ ,d. 



V diH(x)ait 



< KiHix), 



Y^didjH(x)aikajk < k^. 



(3.1) 

(3.2) 
(3.3) 

(3.4) 
(3.5) 



Moreover, we also assume the following local Lipschitz condition: for any R > and all 
x,yeW' with H{x), H(y) < R, 

\b{x)-b(y)\<Cj,\x-y\. (3.6) 

It should be noticed that stochastic differential equation (13.11) can not be solved by using 
Yt = X, - AWs, to transform (13.11 ) into an ordinary differential equation with time-dependent 
coefficients, since the above conditions are not invariant under this transform. Moreover, a direct 
application of Ito's formula seems not work because of the nonlocal feature of Levy processes. 

The main aim of this section is to prove the following estimate. 

Theorem 3.1. Assume (1231)- (123). For any initial value x e R'', there exists a unique cddlcig 
^,-adapted process t ^ X, solving equation ( 13. il) . and for all t ^ 0, 

'^^^Psem]H(X,y 



exp 



en^2|5,| + l) 



H(x) 



Moreover, if we also assume (H^^ ), then for any p > \ and t > 0, 



exp\p sup H{Xs)^ 

se[0,t] 



< C e^<^^ 



(3.7) 



(3.8) 



Proof. First of all, by (13.61 ) it is standard to prove the existence and uniqueness of local solu- 
tions for equation (13.11 ). Our main aim is to prove the apriori estimate (13.71 ). We shall use the 
approximation argument as used in [I3T1 . 

For fixed ^ e S, consider the following SDE driven by discontinuous martingale Wg/. 

dXf = Z7(Xf )df + AdWc^X^Q = x. (3.9) 

Clearly, it suffices to prove that there exists a unique cadlag function t X^ solving equation 
(1X91) . and for all t > 0, 

'2sup,,[o ,] n{x[S 



exp ■ 



€''\K2\tt\ + 1) 
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C e 



H(x) 



(3.10) 



Below, for the simplicity of notations, we drop the superscripts and divide the proof into 
four steps. 

(Step 1). Let us first consider the case that each component of i is absolutely continuous and 
strictly increasing. By Ito's formula, (|3.31 ) and (|3.5I ). we have 



e-'"H(Xr) = H(x)+ f e-'^Xb-VH -KiH)iX,)ds+ f e-'' \VHiX,),AdWe^) 
Jo Jo 



< H(x) + ^ c-'^-'iVHiX.XAdWO + '^\Q. (3.11) 

For R > 0, define the stopping time 

tr := mf{t > : \X,\ > R}. 
Taking expectations for both sides of (13.1 IK we obtain that for all t > 0, 

E(e-'^'<'"^'^)//(X,,,j) < H{x) + 

This implies by (13.21 ) that 

lim Tr = oo. (3.12) 

R->oo 

(Step 2). Write for A>0, 

Mf :=a[ e-'"'{VHiX,),AdWe^). 
Jo 

Then by (I3.11|) . we have 

exp{Ae''''HiXt)} < exp [aH(x) + exp [Mf] . (3.13) 

Notice that 1 1-> Mf^ is a continuous local martingale with covariance 

r' 2 i |X4l 

{M\:=A^Yj e''''YjdiH{X,)ait df', k A^iGMA, (3.14) 

k J" i 

where 

Gr.= sup(e-'^'^//(X,)). (3.15) 

.ve[0,r] 

By Novikov's criterion (cf. [|23l ). one knows that 

t ^ exp - \{M^),;^^^ is a continuous exponential martingale, 

and by Doob's inequality about positive submartingales and Holder's inequality, 

Eexpjsup M'A < 2(Eexp|2M/,,J)^ 



lie[0,f] 



< 2(Eexp|Mf4 - \{M'\^,^]y (Eexp {8(M'^>,^,,)) 

= 2(Eexp|8<M^,,J)\ 
Recalling (I3TT51) and by (l3J3l) and (ITUl) . we have 

Etx■p[AGt^r^ < exp(.l//(x) + ^l^jjEexpi sup M 



ve[0,r] 
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Thus, if one takes A = -^i^^;^^, then 



S(K2\Q + l)r l6(/.2K.I + 1) ^ 12/.2 j " " 

Finally, by Fatou's lemma and (13.121) . letting 7? ^ oo, we get 



f sup.,M//(X.) ) f sup,,.,„,„(e-'"H(X,)) ) 
"°'^Pi 8e-.W,Kl) r°°^''\ 8teK,Kl) }<C....,e". (3.16) 
(Step 3). For general £ e S, let us define the Stelkov's average of £ by 



J'" t r t 
4d^ + - = I ^f+w„d5' + -. 
, n Jo n 



It is clear that ? i-> ^" is absolutely continuous and strictly increasing. Moreover, for each t > 0, 

C]it,. (3.17) 
By (|3.16l) one has the following uniform estimate: 

f sup,,[o,]//(xr) ) 

^'''P\8e-'(y.2lCI + l)J ■ ^ ^ 

If we define 

:=inf{?^0://(Xf)>i?i) 

and 

tk, :=inf|?^0://(Xf)>i?2), 
then by (|3.6I) and equation (13.91 ). we have for ? < r^^ A trj, 

|Xf-Xf|< r |Z7(Xr)-K^f)|d* + ||A||-|W,«-W,,| 
Jo 

<C«,v«, r |Xf -Xf|d5 + ||A||-|W,;, 

Jo 

which yields by Gronwall's inequality that 

|Zf - Xfl < IIAII • - + exp {C«.v«2^l ll^ll r IW^^? - W^^Jd^. 

Jo 

Now, for any e > 0, by Chebyschev's inequality and (13.181) . we have 

P {|Xf - X\\ >s,t< Tr,} <P[t>Tl^} + P [\Xf - Xf I > ? < 4, A tr,} 



< p| sup //(Xf ) > r\ + p[\\A\\ ■ m.. - Wi,\ > ^] 

l.ve[0,r] ) ^ ^> 

+ p|exp{C«,vfi,?} IIAII j| m.; - We^ds > I 

2 / ,„ \ 2||A|| 

< — supE sup H(X^. ) + ^E|W,. - W,,\ 

, 2exp{Q,v^,fll|A|| r' 
S Jn 
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e Jo 



which tends to zero by (13.171 ) as n ^ oo and — > oo. 

Let Q be the set of all rational numbers. By a diagonalization argument, there exists a com- 
mon subsequence and a null set such that for all a» ^ and ? e Q n [0, rn^io))]. 



lim |Xf""M-XfM| = 0. 



Thus, by Fatou's lemma and (13.181 ). we obtain 



8e-'(^2l^.l + 1) j-^"'^P| 8en/^2l^,| + 1) j 

= E exp < sup lim inf 

l.se[0,rArr,]nQ — 8e'^''(^2lC"l + l) 



[ ^^P.ve[(),rAr/i2 ]nQ ^(^i ) 



< lim inf E exp < - 



I 8e'^''(/^2lC"l + 1) 
< ^2,^,3 exp . 

Finally, letting R2 ^ oo,we obtain (|3.10l) . 

(Step 4). As for (13.81 ). by Young's inequality we have 



By Holder's inequality and (|3.7I) . we have 



exp<{p sup H{Xs)^ 

sem] 



<r p^/W/'lRp2Cpte|5,|+l)\2 ^ H(x) 



where the second inequality is due to (H^^). □ 

4. Malliavin Covariance Matrix 
In the sequel, in addition to (I3.3I) - (I3.5I) . we also assume that for any m e No and some qm > 0, 

\V"'b{x)\ < CiHixf'" + I), (4.1) 

where 

^1 G[0, i]. 

By Theorem 13. 1[ it is easy to see that 

w ^ X,(x, w, £) e D~(R'^), 

X ^ Xtix, w, £) e C°°(R'^). 
Let Jt = Jt{x) = VX,(x) be the derivative matrix of X,{x) with respect to x. Then Jt satisfies 

7^ = 7+ r Vb{X,)-JAs. (4.2) 
Jo 

Let Kf be the inverse matrix of 7,. Then Kt satisfies 

Kt = I- f K, -Vb{X,)ds. (4.3) 



We prepare the following basic estimates for later use. 
Lemma 4.1. Assume (H^^ ). For x e W', let Xt{x) be the solution ofSDE f li.il) . 
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(i) For any p > I, there exists a constant Cp > such that for all t e [0, 1], 



sup <C/. (4.4) 

.ve[0,f] 



(ii) There exists a constant > such that for all t e [0, 1] and s > 0, 

pjsup |X,W-x|>4<^- (4.5) 

lve[0,r] J ^ 

(Hi) For any p > 2, there exists a constant Cp^x > such that for all t e [0, 1], 



sup \J,{x) - /r + E sup \K,(x) - /r U CpjP. (4.6) 

sem] / \.se[Q,t] / 

(iv) For any p ^ 2 and m,k e No with m + k ^ 1, there exists a constant Cp^mXx > such that 
for all t e [0, 1], 

(1, m = 0,k= 1; 
t, m=l,k = 0; (4.7) 



e(sup \\D'"V'X,,(x)\\']<Cp,^,,,x 
\sem] I 



tP, m + k>2. 



Proof, (i) By (12.11) and (H^^ ), we can write 

St = t\&+ I MV5(dM) + I ufi(t,du) =: t^' + I ufi{t,du). 
By Ito's fonnula, we have 

\sr = p f \s,rHSs,&')ds+ f f (i5,_ + Mr-i5,_rkd5,dM) 

Jo Jo Jv4 ^ ' 

+ Jl^'j^^ + u\P - \S,.\P - p{u,S ,J)\S ,.r'-)ys(du)ds. 

Taking expectations and by Young's inequality, we obtain 

<Cp [ E\S,r^ds + Cpt [ \u\''vs(du)<Cp [ E\Ssfds + Cpt, 

Jo JRi Jo 

which then gives the estimate (14.41) by Gronwall's inequality and that each component of 5; is 
increasing. 

(ii) Noticing that 



sup \X,(x) -x\< [ \biX,(x))\ds + sup \WsX 

te[0,t] Jo se[0,t] 



by Chebyschev's inequality, we have 

P I sup \Xsix) - X\> S> <: 



^(t [ E\biX,ix))\^ds + E( sup \Wsf) 

£ \ Jo ^ sem] ' 

^1?^ (E|//(X,(x))r + l)d5 + E|5,|j, 



which yields (1431) by (IXHl) and (gZl). 
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(iii) By (giU), we have 

17, r \VbiX,)\-\J,,-I\ds+ [ \Vb(XMs. 
Jo Jo 

which yields by Gronwall's inequality that 

17, - /| < (exp ( f \Vb(X,)\ds] + l] f \Vb(XMs 



By (lO) with qi e [0, ^] and (1X81) . we obtain (14^61) . 
(iv) Notice that for heB., 



DhX,= [ 
Jo 



Vb{X,)DhX,4s+Ahs,. 



(4.8) 



Let {/i", n G N} be an orthonormal basis of H. Then 



\DXt\ 



V r' ( 

J]\DM^ < \Vb{X,)\-\\DX,\kds+ J]|A/i^,| 



1/2 



By Gronwall's inequality and (14.101 ) below, we obtain 

||DX,||H<||A||-|5,r/2 + exp|j|^ \Vb{XM^^^ IIAII-IS^r^^d^, 

which, by (|X8l ), (|4Jl ) with (^rj e [0, |], Holder's inequality and (i), then gives (14771) for m = 1 
and k = 0. For the general m and fc, it follows by similar calculations and induction method. □ 

Remark 4.2. From the above proof, it is easy to see that ifbe C^(W^), then Cx in ( 14.51) . Cp^x in 
A4.6\i and Cp^mXx ( 1^.71) can be independent of x e W^. 

We need the following simple formula about the change of variables (cf. jMj). 

Lemma 4.3. Let f : M.^ ^ R be a bounded measurable function, and /z : R.+ ^ R an absolutely 
continuous function with integrable derivative. Given a cadlag increasing function i, we have 



Jo Jo 



fe-'h,ds. 



(4.9) 



where t 



-1 .. 



inf{^ > : 4 > t}- 



Proof. By definition, it is easy to see that 



and 



> a ^ t > ia. 



Thus, for 0<a<Z?<?we have 

(4,4)c{5:Ci 6(a,Z7]}c[4,4]. 

Hence, 



r'i(«,/.](c')M^= r 

Jo Jo 



l(4,4](^)A,d^ = he^-he 



Jo 



h]{s)dhe^. 



In particular, (14.91 ) holds for step functions. For general bounded measurable /, it follows by a 
monotone class argument. □ 
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Lemma 4.4. Let f,g:^^^W^ be two bounded measurable functions, and {h'^,n e N} an 
orthonormal basis o/H. We have 

Proof. If we define 

and let fs = {f},---, ff), then by formula (14.91 ). we have 

f.-dhl= l-hlds. 
Jo 

Thus, by Parsavel's equality, the left hand side of (|4.10l) equals to 

Jo ^"HU ^"'"'ri, ^ ■^^'^=$ 1 4),'4)-d^' 

which then gives (14.101) by (14.91 ) again. □ 

The following lemma originally appeared in the proof of [|T4] Theorem 3.3]. 

Lemma 4.5. Let := {DXl(x),DX{(x))^ be the Malliavin covariance matrix ofX,{x). 

We have 



iUx))*. (4.11) 



'5, ' 



Proof By (|4.2|) . (|4.8I) and the variation of constant formula, we have 

D,X,ix)= f J,K,ix)Adhs,. 
Jo 

Let {/z", n e N} be an orthonormal basis of H. Then, 

^rix) = Dh"X,{x) ■ (DMx))* = E (X j ■ Ux)KAx)Adhl 

which in turn gives the formula (|4.111 ) by (14.101 ). □ 

5. Proof OF Main Theorem 
In this section we consider the following SDE 

X, = x+ f biX,)ds+AWs,^ x+ f biX,)ds + AW,<,.t + [ AyNit,dy), (5.1) 
Jo Jo Jr'' 



where, in addition to (Hj^ ) and (H^^ ), we assume that b e C~(R ) and 
(H^) For some some Lyapunov function H and ki,K2, ki, > 0, 

b{x) ■ VH{x) < KiH(x), I ^ diH{x)aik < KjHix), ^ didjH{x)aikaj], < ^-3, (5.2) 

and for any m e No, there is a <5r^ > such that 

\^"'b{x)\ < Cmxf'" + 1), (5.3) 

where q\ e [0, 
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(Hp For some K4, K5,k^ > 0, 

\{Vbix + Ay) - Vb{x))A\ < ^4(1 A \y\), 
\iVbix+Ay) - Vb(x)-Ay ■ V^bix))A\ < K^lyf, 
inf inf (\uAf + \uVbix)A\^) = Ke > 0. 

xeRd |w|=l ^ ' 

The following estimate is the key part for proving the smooth density of Xt{x). 



(5.4) 
(5.5) 
(5.6) 



Lemma 5.1. Let 9 be given by U.8\l . For any p > I and x e W^, there exists a constant 
C = C{p, d, 0,x) > Q such that for all t e (0, 1], 

maY.m'X^ct-'^- 

Moreover, if for all m e N, qm = in 0.iD . then the above constant C can be independent ofx. 

Proof. We divide the proof into four steps. 
(Step 1). Set 



Yr := uKtA, /3t := uKtVb(Xt)A, ft := uKtV^biXr)A, 



7t ■= uKt 



{Xt) 



2 b' ■ diVbA - (Vbf-A + ^ Y,(didjVb)aikajk&, 

i ijk 

+ uK, j^^ {yb{X, + Ay) - Vb{X,) - Ay ■ V^b{X,))Avddy), 



gfy) := uK,{Vb{X,.+Ay) - Vb{X,.))A. 
By equations (14.31) . (15.11) and Ito's formula, one sees that 



Yt = aA+ 15 As, 



Jo 



and 



l3t = aVb{x)A+ r 7,d5+ r Q,As+ ff gs{y)msAy). 
Jo Jo JoJr'' 

By (l53])-(l577]). it is easy to see that 

\gr(y)\ < cm A \y\), 

and for some ^ > 0, 

m + \rr\ + \Qr\ < c\Kmx,y + 1). 

(Step 2). Fori? > 1, define the stopping times 

Tr := inf I? > : \Kr\ > R, H{Xt) > r]. 



and 

For 77 e (0, 1), set 



and for 5 e (0, |) and 7? > 1, 



To:=mf[s>0:\K,-I\> \]. 



Er---- 



\uK,A\^ds < en , 



Ff := 1^ \uK,Vb(X,)A\^ds < 9R^s''^^ . 
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By Lemma there is a constant Ci > such that for all < e < t^^^ < 1 and i? > 1, 
n < T«}) = n (Ff^)^ n < t«}) + n ^ n {r < t«}) 

-- ^ + /'(^r n Ff« n {To > + /'(to < e^"). 
On the other hand, by (|5.6I ) we have 

£f n Ff c (|Mi^,.Ap + \uK,^b{X,)A\^)As < + 9i?^£'"'| 

c \ —— \uK,Yds < lOR^s"^ 

[Jo \uK,\^ 

c |/^6 \uK/ds < lOi^^e'^"! . 
Since for any \u\ = 1 and s e [0,to], 

\uK,\ > 1 - lis:, - /| > i 



it is easy to see that for any s < (3^)*', 



n Ff n {to > e^"} = 0. 
Hence, for 77 e (0, 1), 5 e (0, f), > 1 and e < (^)^, 



p(Et n{t< tr}) < 4 exp — -— + p(to < s'"). (5.7) 



(Step 3). Now, by Lemma [ITTI and (15.71 ). we have 



+ P jj^ \uK,A\^ds <s'>;t< Tr| + /'(t« < t) 



< exp < 1 > + 4 exp 



+ p(to < e'"') + /'(ts < t), (5.8) 

where 

77 e (0,1), 5e(0,i), 7?>1, e<(^)^- 
For any p > 1, by Chebyschev's inequality and (14.61 ). we have 

/'(To < /") = P I sup lis:, - /| > U < [ sup \K, - If] < CeP^\ (5.9) 



ie(0,e'''') 



Vie(0,£'''') 



and by and (TO . 

-fv' \se[0,f] ' j Kt' 
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Let 9 be given by (IL8I) . If we choose 

^ c- 1 „ -JL 

24 

then by ^M, ^3 and (l5J0l) . we get for any ? e (0, 1), p > 1 and s e (O, ' ), 

pdS^ < ei < Ce". (5.11) 



(Step 4). Let 



:=infy r |i<i^,a.,pdSi 



Since 5f has finite moments of all orders, by (|4.71 ) and a compact argument (see [|20l p. 133, 
Lemma 2.3.1] for more details), for any p > I, there exists a constant Cq = Co(p,d,K(,) > 
such that for all e e (0, Cot~), 



Hence, for all t e(0,l], 

Jf>oo /->C(, ( /-«oo 

Jo Jc^-Tt 



The desired estimate now follows by (14.61 ) and noticing that the smallest eigenvalue of a real 
symmetric matrix M is less than (det Mp. □ 

We are now in a position to prove the following main result of this paper. 

Theorem 5.2. Under (Hj^ ), (H^^), (Hj,) and (H^), the solution X,{x) of SDE 0.71) admits a 
smooth density p(t, x, y) as a function on (0, oo) x R'^ x R''. Moreover, we have the following 
conclusions: 

( i) For each t > and x e Mf', p(t, x, •) e S(W^) and solves the following Fokker-Planck 
equation: 

dtp = Lp{t, X, •) + div{bp{t, X, •)), (5.12) 

where 

£f(y) = P.y. f (f(y + Az)-f(y))vddz) + \Yididjf)(y)ai,aj,&k. 

(ii) There exist constants fii,/32,fi3 > only depending on d and such that for all (t, x,y) e 
(0, 1] X R^ X R'^, 

p(t,x,y)<cJt''''ilA—^]], (5.13) 



where continuously depends on x. 
(Hi) Suppose that b e C^iW^), then Cx in d5.i3P can be independent of x. 

Proof. For fc, m 6 N, by the chain rule, we have 

k 

V'=E(V"Y)(X,(x)) = E((V"'+V)(^r(-^))GXVX,(x), • ■ ■ , V'X,{x))\ 

7=1 
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where {Gj, j = 1 , ■ ■ ■ ,k} are real polynomial functions. By Theorem 12.5 1 and Lemmas 14.11 15. 1[ 
one finds that there exist y^t > and C > such that for all t e (0, 1), 

\V'E(Y"f){X,(x))\ < Cll/lUr^*'". (5.14) 

Now, by Sobolev's embedding theorem (see [l20l pp. 102-103]), for each (t,x) e (0, oo) x W^, 
there exists a smooth density p(t, x, •) 6 SiR!^). Moreover, 

{x,y) ^ pit, x,y) e C"(]R^ x R'^). 

By Ito's formula, one sees that p satisfies equation (15.121) . The smoothness of p(t,x,y) with 
respect to the time variable t follows by equation (15.121) and the standard bootstrap argument. 

Now we use a trick of Kusuoka and Stroock lfT6l to prove (|5.13l ). Let;^' • K-'^' ~^ [0, 1] be a 
smooth cutoff function with;^f(3;) = for \y\ < ^ and xiy) = 1 for |j| > |. For s > 0, define 

Xs(y) ■=x(y/£), xoiy) = i. 

By (|2.11l) . we have for any q > d. 



- x)p(t, X, OIU < C\\Xe{Xt{x) - x)\\~ 



Y,\\H(r,{Xix),\% 

V i ) 



X 



2l|//(,)(X,(x),;t-.(^,(^)-^))|[ 



By (12.91 ), (12.81) and Holder's inequality, we have 

||//(0(X,(^),;r,(X,(x) - .^))||, < WXeiW - x)\ ■ • \\DX,\\^\ 

+ \\Xsi)^lx)-x)-\\DY.-'\\-\\DXM\ 
+ \\xMx)-x))-\\L-'\\-\D*DX,\% 

+ \\X.{Mx)-x)%,\\DYr^X,\\DX,%^ 

+ li;r.(^X-^)--^)ll,J|27'll,J|£>x,||i,,3, 

where ^ = ^ + ^ + ^- Let adj(2f) be the adjugate matrix of 2,. Observing that 

= det(i:,)-'adj(2,), = i:;'d^,^;\ 

by the definition of adj(S,), we have 

1127^11,, < ||det(2,)"'ll2,J|adj(i:,)ll2,, < C\\dct(X,y%,,\\DXf,^^:\\^^, 

and 

\m;%^ < ||det(Z,)-i||^^J|adj(2,)||2^J|DX,||2 4^^ 

< cii det(2,)-i||^^j|Dx,ii;S;;;:i^^j|Dx,i|2,^^. 

On the other hand, by (|4.5I ). we have 

\\Xs(Xt(x) - x%, <P{\X,(x) -x\> ff^" < C^, 

and also 

IIVatIIo - ^'"^^ 



W^XeiXAx) - x%, < ^^J^p[\X,{x) -x\> f)'^" < c4 



(5.15) 



l+2/?i 
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Combining the above calculations and by Lemma [STTI and (14.71 ). we obtain 

\\H^i^(Xt(x),Xe(Xt(x) - x))\\g < c-^^ ■ r- ■ ?^^2%3 + c^(r- ■ + r- • t^n^^, ). 

Similarly, we also have 

In (15.151) . taking s = and £ = U - j| separately, by careful choices of parameters, we obtain 



(ii). As for (iii), it follows by Remark 14^ □ 

Now we can see that Theorem ll.3l is an easy application of Theorem 15.21 
Proof of Theorem \L3\ In the situation of Theorem 11.3 [ we set 

/0,0\ lb, 

By (11.111) and (11.121) . it is easy to see that (15^ and (1531) hold. By (11.131) and (11.141 ). one can 
see that (l54l) . (1531) and (1531) hold. 
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